Voice-recognition camera

ABSTRACT

A camera for taking photographs by voice recognition operations. The camera comprises a microphone through which voiced command words of an operator are registered in a computer as a form of digital data. The computer identifies the same voiced command words in accordance with the registered data and operates the intended functions of the camera. The camera indicates the functioning of the computer for the registration and the recognition of the voiced command words with a display device so that the operator can confirm his operations on the camera.

This is a continuation of application Ser. No. 07/302,175, filed Jan.26, 1989 U.S. Pat. No. 4,951,029.

BACKGROUND OF THE INVENTION

This invention pertains to a voice-recognition camera which operatesupon recognizing a voice input. With the advancement ofvoice-recognition technology, a camera that performs specific operationsupon recognizing an input voice or a key word (vocalinstruction/command) registered in advance has been under consideration.The user of such a camera can release the shutter by simply telling thecamera, "Release." The user does not have to worry about a blurredpicture due to the movement of camera caused by the manual releasingaction, or he can remotely control the camera.

The conventional voice-recognition camera, however, has problems: first,the camera has no means for a user to check whether his/her voice isregistered or recognized by the camera. Consequently, the user cannotdetermine if the cause of failures, such as a register error or amalfunction of the camera upon voice input, is in the voice recognitionsystem or camera mechanism. It is true that there is no approachpresented to this problem so far; second, the vocal instructions forthis type of camera are registered conventionally by a recognitioncircuit system in the register mode according to the sequence determinedby the circuit system. For example, multiple switch are installed on thecamera; the first switch is for registering an instruction voice forrelease operation (for example, "release"); the second switch is forregistering an instruction voice for self-timer operation (for example,"self-timer"), and so forth.

However, under the conventional registration system, the user mustunderstand the corresponding relations between individual input switchesand camera operations, and it makes the voice registration systemcomplicated. This often causes erroneous registration, for example, bydepressing the switch for the self-timer when the switch for the releaseoperation should be depressed instead. Moreover, changing a registeredinstruction voice is similarly complicated.

SUMMARY OF THE INVENTION

The basic concept of this invention should be a camera without theaforementioned problems. The present invention aims to provide a camerawith a means of display to indicate registration or recognition of avocal instruction, in order to solve the aforementioned first problem offunction recognition of the vocal operation means.

Another object of this invention is to provide the camera with thesimpler configuration for voice registration in relation to theaforementioned second problem. In the present invention, an embodiment,which enables the camera to register a vocal instruction to operate thecamera by depressing an actual operation switch of the same camerafunction in the register mode, is possible.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of the circuit configuration of an embodimentof the voice-recognition camera according to the present invention,

FIG. 2 is an enlarged diagram showing the camera display section,

FIGS. 3(A) and (B) are mounting diagrams of a voice input microphone,

FIGS. 4(A) and (B) are mounting diagrams of a voice input microphone fora camera with a zoom lens,

FIG. 5 is a block diagram of the circuit configuration of an embodimentof the voice-recognition camera according to this invention, and

FIG. 6 is a flowchart explaining the operation of above embodiments inthe recognition mode.

DETAILED DESCRIPTION OF THE INVENTION

FIG. 1 is a block diagram of the circuit configuration of an embodimentof the voice-recognition camera according to the present invention.

In FIG. 1, numeral 1 indicates a voice-input microphone to be mounted onthe back cover of a camera; numeral 2 indicates an amplifier whichamplifies inputted aural signals; numeral 3 indicates avoice-recognition circuit which judges whether inputted aural signalsmatch the registered vocal commands; and if yes, it outputs signalsaccording to the vocal commands; numeral 4 indicates a microcomputerwhich controls individual sections of a camera according to the outputsignals from voice-recognition circuit 3; numeral 5 indicates aphotometric circuit which measures the brightness of a subject by usingphotodiode 6; numeral 7 indicates the shutter control circuit whichturns magnet 8 on or off for controling the shutter speed; numeral 9indicates the automatic focusing circuit which checks the focal point ofthe photographing lens and moves it to a focusing position; numeral 10indicates a drive circuit for controling film feeder motor 11.

Concerning camera operation switches, numerals 12 and 13 respectivelyindicate switch S₁ and S₂ ; if the release button is lightly depressedfor one stage, switch S₁ (12) is turned on, and if the release button isfurther depressed, both switches S₁ (12) and S₂ (13) are turned on. Inthe photographing sequence of the camera, if switch S₁ (12) is turnedon, the intensity of light and range are measured in sequence and ifswitch S₂ (13) is turned on, the lens and shutter are driven and thefilm is wound up. Numeral 14 indicates the self-timer operating switch;and numeral 15 indicates the rewind switch.

Numeral 16 is the vocal instruction register switch, which consists ofmatrix switches and connects to voice-recognition circuit 3. Registerswitch 16 comprises a switch for registering vocal instructions forsetting photographic modes and a switch for registering vocalinstructions for setting up photographic conditions under individualphotograhic modes. The former comprises switch E (16a) which registersvocal instructions for correcting exposure, switch M (16b) whichregisters vocal instructions for multiple exposure, and switch I (16c)which registers vocal instructions for interval exposure; the lattercomprises "+" switch 16d which registers the vocal instruction forsetting an over-exposure in the exposure correction mode, "-" switch 16dwhich registers the vocal instruction for setting an under-exposure, andnumeral switch 16f which registers the vocal instruction for setting thecompensation for an iris diaphragm, the number of frames for multipleexposure, and the interval time for interval exposure.

For register switches, switch F (16g) registers the vocal instructionfor focus lock; switch ST (16h) registers the vocal instruction for theself-timer, and switch R (16l) registers the vocal instruction forrewinding film. Voice-recognition circuit 3 enters the voice registermode if register switches 16 are operated wherein all camera driving isinhibited except for display 18. If register switches 16 are notoperated, voice-recognition circuit 3 changes to the voice-recognitionmode.

Using these register switches, the instruction voice as outlined in thefollowing table may be registered.

    ______________________________________                                        Register switch: Vocal instruction (examples)                                 ______________________________________                                        Switch E, 16a:   "Exposure"                                                   Switch M, 16b:   "Multiple Exposure"                                          Switch T, 16c:   "Interval"                                                   + Switch, 16d:   "Over"                                                       - Switch, 16e:   "Under"                                                      Switch F, 16g:   "Focus Lock"                                                 Switch S, 16h:   "Release"                                                    Switch ST, 16k:  "Self-timer"                                                 Switch R, 16l:   "Rewind"                                                     Numeral switch                                                                16f:                                                                          0                "Zero"                                                       to               to                                                           9                "Nine"                                                       ______________________________________                                    

Numeral 17 indicates the display operation (drive) circuit which drivesdisplay section 18 according to the output from voice-recognitioncircuit 3 or microcomputer 4.

Display section 18 is installed, for example, on the upper part of thecamera for easy recognition of its indication. It is configured with adevice such as liquid crystal display as shown in FIG. 2.

FIG. 2 shows that numeral 18a indicates the "ES" part of the displaywhich functions if a vocal instruction for exposure compensation isregistered by the voice-recognition circuit during the register mode, orrecognized by the circuit during the recognition mode; numeral 18bindicates the "ME" part of the display which functions if a vocalinstruction for the multiple exposure is registered or recognized;numeral 18c indicates the "IT" part of the display which functions if avocal instruction for the interval exposure is registered or recognized;numeral 18d indicates the numeral display part which indicates numbersif a vocal instruction for a numeral is registered or recognized;numerals 18e, 18f, and 18g indicate the time display parts whichindicate the time if respective vocal instruction for an interval timeis recognized; these time display parts indicate from left to right:hours, minutes, and seconds.

Numeral 18h indicates the display part for overexposure mode whichfunctions if a vocal instruction for overexposure setting is registeredor recognized; and numeral 18k indicates the display part forunderexposure mode which functions if a vocal instruction forunderexposure setting is registered or recognized.

Numeral 18l indicates the S₁ mode display part which functions if avocal instruction for focus lock is registered or recognized; numeral18m indicates the S₂ mode display part which functions together with S₁mode display part 18l if a vocal instruction for shutter operation isregistered or recognized.

Numeral 18n indicates the self-timer mode display part which functionsif a vocal instruction for self-timer operation is registered orrecognized; and numeral 18p indicates the rewind mode display part whichfunctions if a vocal instruction for rewind operation is registered orrecognized.

Moreover, numeral display part 18d indicates photographic conditions forspecial photographing and the number of photographed frames of the filmin the camera. The registration by vocal instructions will be explainedby quoting the case of a special photographing.

If switch E (16a) is turned on, "ES" part of the display 18a startsblinking.

If a command "Exposure" is inputted, voice-recognition circuit 3registers it as the vocal instruction to activate the exposurecompensation mode. Once it is registered, "ES" part of the display 18astops blinking and remains; it stops its indication if switch E (16a) isturned off thereafter. Then, if switch M (16b) is turned on, "ME" partof the display 18b starts blinking. If a command "Multiple Exposure" isinputted, it is registered as the instruction voice for setting themultiple exposure mode.

Once it is registered, "ME" part of the display 18b stops blinking andremains; it stops its indication if switch M (16b) is turned offthereafter. Similarly from there onward, the vocal instructions (see theaforementioned table) are registered in correspondence with theindividual switches that configure register switch 16. During theregistration, "IT" part of the display 18c, numeral display part 18d,overexposure mode and underexposure mode display parts 18h and 18k allblink, remain and stop their indications similarly to "ES" part of thedisplay 18a and "ME" part of the display 18b. In addition to thosedisplay parts, S₁ mode display part 18l and S₂ mode display part 18m,self-timer mode display part 18n and rewind mode display part 18p alsooperate in the same way. By these indications, the user can recognizethat individual vocal instructions have been registered.

The recognition mode operation will now be explained. For the operationof special modes, a vocal instruction is inputted through microphone 1to set up a photographing mode and its conditions.

Supposing now that an underexposure photography is to be taken withsetting the diaphragm two stops under, the photographing mode is firstset up by inputting a vocal instruction "Exposure" through microphone 1.If the instruction "Exposure" is recognized, "ES" part of the display18a indicates the confirmation that recognition has been made by thecamera. Voice-recognition circuit 3, upon recognizing the mode, entersthe state for recognizing photographing condition, and if a vocalinstructions "Under" is then entered, underexposure mode display part18k indicates that the instruction "Under" has been recognized. Then, avocal instruction "Two" is entered through microphone 1.

If voice-recognition circuit 3 recognizes the instruction "Two", numeraldisplay part 18d displays "2". This completes the setting of thephotography mode and condition, and voice-recognition circuit 3 outputssignals corresponding to the set mode and condition to microcomputer 4,which controls individual sections of the camera to take a photographwith an underexposure effect, once it has been started.

The same procedures apply to the multiple exposure mode: "ME" part ofthe display 18b functions if a vocal instruction "Multiple Exposure" isentered through microphone 1; if "Zero" and "Eight" are entered insuccession, numeral display 18d displays "08"; and voice-recognitioncircuit 3 recognizes that a multiple exposure of eight frames isinstructed.

For the interval exposure mode, if a vocal instruction "Interval" isentered, the "IT" part of the display 18c indicates for the confirmationthat the system is now in the interval exposure mode. Thevoice-recognition circuit 3 becomes to a standby state for inputtinginterval time instructions, and if "Zero", "One", "Five", "Zero", "Zero"are entered in succession, the hour display part 18e displays "01", theminute display part 18f displays "15", and the second display part 18gdisplays "00", for the confirmation that an interval time of one hourand fifteen minutes has been recognized. If "Zero" and "Three" areentered for setting the number of frames to be photographed, the numeraldisplay part 18d displays "03". The result of recognition by thevoice-recognition circuit 3 is turned out to the microcomputer 4, whichcontrols the individual sections of the camera accordingly, and thecamera repeats photographing operations for three frames with theinterval time of one hour and fifteen minutes.

The other displays function in the same way. In other words, if a vocalinstruction "Focus Lock" is recognized, S₁ mode display part 181functions, and if a vocal instruction "Release" is recognized, both S₁mode display part 181 and S₂ mode display part 18m function. Moreover,if vocal instructions "Self-Timer" and "Rewind" are recognized,self-timer mode display part 18n and rewind mode display part 18pfunction respectively.

Each of the aforementioned display parts are turned off with thecompletion of camera operation.

In the aforementioned embodiment of this invention, voice-recognitioncircuit 3 has registration and recognition modes as its operation modes;it is possible to add a checking mode to the operation modes. If acamera is used after it has not been used for a long time, the user maywish to check if the camera recognizes a registered vocal instruction,or if a certain vocal instruction is already registered in it. For sucha case, the voice-recognition circuit should be set to the checkingmode; the camera may not operate even if an vocal instruction isinputted, but display 18 should display the result of recognitionaccordingly.

FIG. 3(A) shows the installation position of microphones to avoice-recognition camera in which first voice input microphone 20 isinstalled to the lower section of the back cover of the camera.Microphone 20 may be installed at the bottom section of the camera orelsewhere from where it can easily catch the user's vocal instructionswhile he/she views a subject through finder 22.

Moreover, to catch a vocal instruction from the front of the camera(e.g. group photographing), second microphone 23 is installed in frontof the camera as shown in FIG. 3(B). Switch 24 interchanges firstmicrophone 20 to second microphone 23 and vice versa. However, if thecamera is in register mode or voice registration is enforced by theregister switch 25, the registration is accomplished with firstmicrophone 20 while second microphone 23 is turned off.

For second microphone 23, a type which has a forward directivitycorresponding to the photographing angle is used. That is, microphone 23receives a voice input only if the vocal instruction is made within thephotographic angle of field.

For a camera with a zooming function, microphone directivity may bechanged according to the zooming position of lens.

For example, as FIG. 4(A) shows, microphone 27, which can move in thedirection of optical axis of the camera lens, is installed inside ofmicrophone hole 26a on main camera body 26.

Microphone 27 is connected to zoom lens 28 by lever 29. As FIG. 4(B)shows, if zoom lens 28 zooms forward, microphone 27 moves to the reversedirection, that is the direction to the bottom of microphone hole 26a.This narrows down the directivity of microphone 27, and makes itadjustable to the change of the photographic angle of field. As thus fardescribed, this invention has solved the first problem by displaying theregistration or recognition of vocal instructions; therefore, thisinvention offers the following advantages: It is possible to check theoperating state of the voice-recognition means, thus preventingerroneous registrations of vocal instructions, and allowing the user todetermine whether the voice-recognition system or the camera mechanismis the problem when the camera fails to operate in response to a vocalinstruction.

The embodiment of the present invention, in which the camera operatingswitches which are also configured to serve as input switches forregistration, will be explained. In this way, switch operations aresimplified as to acchieve the second aim of this invention.

FIG. 5 is a block diagram of the circuit configuration of the secondembodiment of a voice-recognition camera according to this invention. InFIG. 5, the parts numbered identically to those in FIG. 1 have identicalfunctions.

In this embodiment, one of the terminals of camera operating switches 12to 15 is grounded while the other terminal is connected via a diode tomicrocomputer 4 and input terminals I₀ to I₃ of voice-recognitioncircuit 3.

Switch 160 changes the recognition mode to registration mode and viceversa; one of the terminals is connected to voice-recognition circuit 3.If mode switch 160 is on, the camera system is in registration mode andif it is off, the system is in recognition mode.

The operation of the present embodiment is described below.

To register a vocal instruction, while mode switch 160 is turned on, aswitch for a desired operation selected from switches 12 to 15 is to beoperated, so that the vocal instruction is inputted throughmicrophone 1. Voice-recognition circuit 3 turns out a signal to the SOterminal of microcomputer 4 to make the computer inoperable; accordingto the signal received from mode switch 160 and a selected operatingswitch, the circuit registers a voice input as a vocal instruction toactivate the same function as the camera function which is also startedby the aforementioned switch. The following table outlines the signallevels of input terminals I₀ to I₃ of voice-recognition circuit 3 andgives examples of the vocal instructions when individual operatingswitches 12 to 15 are turned on.

    ______________________________________                                        Operating switch                                                                         I.sub.0                                                                             I.sub.1                                                                             I.sub.2                                                                           I.sub.3                                                                            Vocal Instruction                                                                        D.sub.0                                                                           D.sub.1                        ______________________________________                                        S.sub.1    0     1     1   1    "Focus Lock"                                                                             0   0                              Switch 12                                                                     S.sub.2    0     0     1   1    "Release"  0   1                              Switch 13                                                                     Self-timer 1     1     0   1    "Self-Timer"                                                                             1   0                              switch 14                                                                     Rewind     1     1     1   0    "Rewind"   1   1                              switch 15                                                                     ______________________________________                                    

For example, the release button is lightly depressed to turn on switchS₁ (12), and the vocal instruction "Focus Lock" is inputted throughmicrophone 1 and the release button is further depressed to turn switchS₂ (13) on and the vocal instruction "Release" is inputted; self-timerswitch 14 is similarly turned on and the vocal instruction "Self-Timer"is inputted; the vocal instruction "Rewind" is also able to be inputtedafter turning on rewind switch 15.

This completes the registration of each voice input as the instructionfor the function which is identical to that of the corresponding switch.

The operation in the recognition mode is explained below. If mode switch160 is turned off, the camera becomes to the recognition mode;voice-recognition circuit 3 turns out a start signal to the SO terminalsof microcomputer 4 so that the computer becomes operable. Microcomputer4 is now ready to be operated by the outputs from eithervoice-recognition circuit 3 or operating switches 12 to 15.

The functions of this embodiment, according to the invention, aredescribed with reference to the flowchart of FIG. 6.

If a voice input is inputted (F-1), voice-recognition circuit 3 judgeswhether the inputted voice matches the registered vocal instruction(F-2); and if yes, it turns out a corresponding signal (2-bit signal) toterminals D₀ and D₁ of microcomputer 4 (F-3). An example of this signalis indicated at the right-hand end of the above table. For example, ifthe vocal instruction "Focus Lock" is recognized, "O" and "O" signalsare turned out to input terminals D₀ and D₁ of microcomputer 4respectively.

According to the output signals from voice-recognition circuit 3,microcomputer 4 operates the camera in response to the inputted voice(F-4). In other words, if the vocal instruction "Focus Lock" isinputted, photometry and range finding functions are done, and with theinput of the vocal instruction "Release", the lens and shutter drivesare made followed by film rewinding. If the vocal instruction"Self-Timer" is inputted, the self-timer is into operation, and if thevocal instruction "Rewind" is inputted, the camera starts rewindingfilm.

As thus far described, voice registration is done by using the actualcamera operating switches; therefore, registering procedures become muchsimplified with less chance for erroneous registrations. Moreover, vocalinstructions can be re-registered easily.

Since the camera operating switches are shared as the input switches forregistration, no additional members are required thus contributing tothe low-cost equipment configuration.

Moreover, in the aforementioned description of the second embodiment ofthe present invention, special photographing modes have been omitted andthe registration of vocal instructions, using the actual cameraoperating switches, is realized for a simple configuration; however, theregistration of an individual vocal instruction in the specialphotographing modes is possible by using specialized switches forspecial modes in the same manner as described first embodiment.

Furthermore, in the second embodiment of this invention, checkingsystems with a display for registration and recognition of vocalinstructions have not been mentioned; however, the above mentionedchecking operation can be naturally and easily performed byincorporating the display explained in the description of the firstembodiment into the second embodiment.

For the voice-recognition circuit of the above mentioned embodiments, avoice-recognition IC is used; it is based on the so called specificspeaker voice-recognition which registers the voice spectrum of aspecific speaker. This invention is obviously applicable no matter whattype of voice-recognition system is used; and in the near future, if avoice-recognition camera, that linguistically analyzes voice andoperates by understanding the meaning of such a voice, is developed, thepresent invention may easily be applied to such a camera.

This invention can provide an easy voice registration with an extremelysimple configuration in an embodiment in which a vocal instruction isregistered in the register mode using actual camera operating switches.

What is claimed is:
 1. In a photographic camera including functionsresponsive to voice commands of a user, the camera having a registrationmode and an recognition mode, means in the registration mode forregistering a particular voice command with a selected function, amemory for storing each registered voice command, means in therecognition mode for recognizing a voice command as registered, andmeans in the recognition mode responsive to the recognition means foractivating the function corresponding to the recognized voice command,the improvement comprising:first means in the registration mode forvisually displaying a symbol representative of each function selectedfor voice command registration; second means in the registration modefor visually displaying a symbol representative of each function forwhich a voice command has been successfully registered; and third meansin the recognition mode responsive to a registered voice command forvisually displaying a symbol representative of the function for whichthe voice command is recognized.
 2. The camera of claim 1 also includinga checking mode, means for selectively engaging the checking mode, andmeans responsive to engaging the checking mode for enabling the thirdmeans and disabling the activating means to permit determining whether avoice command is registered for a particular function without activatingthe function.
 3. In a photographic camera including functions responsiveto voice commands of a user, the camera having a registration mode andan recognition mode, means in the registration mode for registering aparticular voice command with a selected function, a memory for storingeach registered voice command, means in the recognition mode forrecognizing a voice command as registered, and means in the recognitionmode responsive to the recognition means for activating the functioncorresponding to the recognized voice command, the improvementcomprising:a display including a visual symbol representative of eachfunction responsive to a voice command; first means in the registrationmode for activating to a first state the symbol in the displayrepresentative of the function selected for voice command registration;second means in the registration mode for activating to a second statethe symbol in the display representative of each function for which avoice command has been successfully registered; and third means in therecognition mode responsive to a registered voice command for activatingto the second state the symbol in the display representative of thefunction for which the voice command is registered.
 4. In the camera ofclaim 1 wherein the functions responsive to voice commands are alsomanually actuable through separate switches, the improvement furthercomprising:means for selectively engaging the registration mode; andmeans in the registration mode responsive to manual actuation of theseparate switch associated with a function for identifying that functionas the selected function for which a voice command is to be registered.5. The camera of claim 1 wherein the functions responsive to voicecommands include camera operation functions also manually actuablethrough separate switches and special photographic functions alsomanually controllable, the improvement further comprising:means forselectively engaging the registration mode; means in the registrationmode responsive to manual actuation of the separate switch associatedwith a camera operation function for identifying that camera operationfunction as the selected function for which a voice command is to beregistered; and a manually operable registration switch for each specialphotographic function actuation of which identifies the associatedspecial photographic function as the selected function for which a voicecommand is to be registered.
 6. The camera of claim 5 wherein theengaging means is a separate manually operable control.
 7. The camera ofclaim 5 wherein operation of a registration switch engages theregistration mode for voice command registration of special photographicfunctions and wherein the engaging means is a separate manually operablecontrol for engaging the registration mode for voice commandregistration of camera operation functions.
 8. In a photographic cameraincluding functions responsive to voice commands of a user and alsomanually operable by separate switches, the camera having a registrationmode and a recognition mode, means in the registration mode forregistering a particular voice command with a selected function, amemory for storing each registered voice command, means in therecognition mode for recognizing a voice command as registered, andmeans in the recognition mode responsive to the recognition means foractivating the function corresponding to the recognized voice command,the improvement comprising:means for selectively engaging theregistration mode; and means in the registration mode responsive tomanual actuation of the separate switch associated with a function foridentifying that function as the selected function for which a voicecommand is to be registered.
 9. A photographic camera responsive tovoice commands, the camera having camera operation functions manuallyoperable through separate switches and manually controllable specialphotographic functions, the camera comprising:a microphone for receivinga voice command of a user; means connected to the microphone forconverting voice commands to representative digital data; a memory forstoring digital data; a registration mode including means connected tothe converting means and memory for digitally registering in the memorya particular voice command with a selected function; a recognition modeincluding means connected to the converting means and the memory forrecognizing a voice command corresponding to a voice command digitallyregistered in the memory and means connected to the recognizing meansfor actuating the function associated with a recognized voice command;means for manually selecting between the registration and recognitionmodes; means in the registration mode responsive to manual actuation ofthe separate switch associated with a camera operation function foridentifying that camera operation function as the selected function forwhich a voice command is to be registered; a manually operableregistration switch for each special photographic function; meansresponsive to actuation of a registration switch for identifying thespecial photographic function associated with the registration switch asthe selected function for which a voice command is to be registered; adisplay including a visual symbol representative of each functionresponsive to a voice command; first means in the registration mode foractivating to a first state the symbol in the display representative ofthe function selected for voice command registration; second means inthe registration mode for activating to a second state the symbol in thedisplay representative of each function for which a voice command hasbeen successfully registered; and third means in the recognition moderesponsive to a registered voice command for activating to the secondstate the symbol in the display representative of the function for whichthe voice command is registered.